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19.  ABSTRACT  (continued) 

’ 

Differences  between  this  and  the  STATSAT  experiment  appear  fi,cst  over  continental,  areas,  bu 
propagate  quickly  over  the  oceans,  especially  in  the  winter.  ->'The  differences  keep  growing 
throughout  the  assimilation  period.  The^forecasts  from  this  experiment,  especially  the 
later  forecasts,  have  little  skill  beyond  2  or  3  days.  Finally  a  fourth  experiment  (NOCOR) 
examines  the  effect  of  denying  conventional  data  only  over  a  particular  region  (Europe  and 
USSR).  The  effect  is  much  smaller  than  in  the  NOCON  experiment,  even  in  the  region  where 
data  was  denied.  Nevertheless  the  differences  keep  increasing  during  the  assimilation 
period  and  some  propagation  of  the  differences  across  the  Pacific  and  into  North  America  is 
observed,  especially  in  winter.  The  forecast  errors,  initially  largest  in  the  region  of 
data  denial,  spread  over  the  whole  hemisphere  in  3  or  4  days. 


1. 


INTRODUCTION 


To  assess  the  impact  of  existing  operational  satellite  retrieval  data  on 
global  atmospheric  analyses,  we  have  performed  four  Observing  System  Experi¬ 
ments  (OSEs) .  One  additional  experiment,  making  use  of  the  experimental  CLA 
physical  retrievals  is  now  underway  and  will  be  reported  later.  Each  OSE 
consists  of  two  one-week  data  assimilation  runs,  one  each  during  Special 
Observing  Period  (SOP)  I  (February  1979)  and  SOP  II  (June  1979)  of  FGGE .  The 
design  and  the  evaluation  of  the  OSEs  are  described  in  detail  below.  The  ob¬ 
servations  used  for  these  OSEs  are  those  of  the  FGGE*  II -b  data  set,  which 
contains  atmospheric  soundings  from  pilot  balloons  and  rawinsondes  (at  six- 
hour  intervals) ,  temperature  and  moisture  soundings  from  the  operational  NOAA 
statistical  satellite  retrievals,  cloud  drift  winds  and  surface  data  from  land 
and  ship  stations  as  well  as  stationary  and  drifting  buoys.  (Not  all  of  these 
data  are  used  by  the  analysis  system.  Details  are  provided  below.)  The  basic 
experiment  for  these  tests  is  a  STATSAT  OSE  in  which  all  data  are  used  in  the 
analysis . 

A  great  number  of  OSEs  have  been  conducted  with  the  FGGE  data  sets.  A 
review  of  ‘this  subject,  especially  with  regard  to  satellite  data  is  given  by 
Isaacs  et  al .  (1986).  The  current  general  conclusions  (Gilchrist,  1982)  are 
that  (1)  satellite  sounding  data  are  vital  to  defining  the  large-scale  struc¬ 
ture  of  the  atmosphere,  and  (2)  the  impact  on  forecast  skill  is  positive  but 
not  very  large  by  conventional  measures,  i.e.,  skill  scores  for  continental 
areas.  The  OSEs  reported  here  show  to  what  degree  these  results  are 
reproduced  when  a  different  data  assimilation  system,  a  different  time  period 
and  different  satellite  retrievals  are  used. 

To  assess  the  impact  of  the  operational  statistical  satellite  retrieval?;, 
the  results  from  the  STATSAT  experiment  are  compared  with  those  from  a  NOSAT 
OSE,  in  which  only  conventional  data  from  the  FGGE  11-b  set  of  observations 
are  used  in  the  analysis.  To  determine  to  what  degree  satellite  observations 
can  replace  conventional  observations,  we  have  repeated  the  STATSAT  OSE  twice, 
once  without  any  conventional  data  (NOCON) ,  and  once  with  conventional  data 


*FGGE :  First  GARP  Global  Experiment 

GARP:  Global  Atmospheric  Research  Program. 


excluded  over  a  specified  continental  region  only  (NOCOR) .  The  results  from 
these  two  OSEs  are  compared  with  each  other,  and  with  the  STATSAT  and  NOSAT 
results . 


1 . 1  Brief  Review  of  Observing  System  Experiments 

The  quantitative  assessment  of  the  potential  impact  of  a  particular 
observing  system  on  global  Numerical  Weather  Prediction  (NWP)  requires  a 
realistic  simulation  study.  Such  a  study  can  help  to  optimize  the  design 
of  a  planned  observing  system  by  exploring  the  sensitivity  of  the  resulting 
impact  to  possible  design  tradeoffs.  It  is  then  called  an  observing  systems 
simulation  experiment  (OSSE) .  Studies  utilizing  real  data,  termed  observing 
system  experiments,  may  also  be  used  to  evaluate  the  usefulness  of  a  particu¬ 
lar  actual  observing  system,  either  using  a  degraded  set  of  observations  or  a 
different  data  treatment.  In  both  OSSEs  and  OSEs,  parallel  4D  assimilation 
and  forecast  runs,  made  with  and  without  a  particular  observing  system,  are 
compared  and  evaluated  objectively  and  subjectively.  In  a  similar  vein,  in 
impact  tests  of  the  model  formulation,  parallel  forecast  ensembles  made  with 
two  different  resolutions,  finite  difference  methods  or  parameterizations  of  a 
physical  process,  may  be  used  to  quantify  a  model  sensitivity. 

There  are  a  number  of  design  and  interpretation  issues  which  must  be 
considered  in  our  discussion  of  impact  studies.  Gilchrist  (1982)  discussed 
the  major  concerns  involving  OSEs.  His  main  points  can  be  summarized  as 
follows.  (1)  When  the  satellite  soundings  used  are  obtained  statistically, 
one  must  bear  in  mind  that  the  situations  when  these  extra  observations  are 
expected  to  be  important  are  not  necessarily  the  "normal"  situations  which 
made  up  the  bulk  of  the  data  base  used  to  develop  che  statistical  retriev¬ 
als.  (2)  The  analysis  systems  have  usually  been  developed  and  tuned  for  con¬ 
ventional  data.  In  particular,  the  statistical  properties  of  the  satellite 
observations  -  low  vertical  resolution,  low  horizontal  variance,  biases  - 
were  not  properly  taken  into  account.  Phillips  (19/6)  analyzed  this  point 
in  detail.  It  is  true  that  over  oceans  these  statistics  are  difficult  to 
estimate;  just  as  the  small  ocean  radiosonde  data  base  makes  it  hard  to 
develop  statistical  retrievals,  it  also  makes  it  hard  to  evaluate  statistical 
retrievals.  (3)  The  sample  of  cases  examined  is  usually  small  and  mav  not  be 
representative.  Also,  predictability  varies  from  case  to  case;  some  cases  are 


relatively  insensitive  to  small  changes  in  initial  conditions.  (4)  Different 
models  will  accept  or  reject  a  particular  type  of  data  to  different  degrees. 
Impact  depends  on  the  specific  model  used.  For  example,  Atlas  et  al .  (1982a) 
found  that  satellite  data  produced  a  larger  positive  impact  when  used  in  a 
model  with  higher  resolution.  (5)  Quality  control  is  necessary  in  any  system; 
there  may  be  a  substantial  impact  on  a  particular  case  due  to  the  inclusion  or 
exclusion  of  a  particular  radiosonde  report  which  is  borderline,  i.e.  which 
deviates  enough  from  the  first  guess  to  be  close  to  the  rejection  criterion. 

In  recent  intercomparisons  of  the  response  of  NWP  systems  to  the  FGGE  data 
base,  some  significant  differences  could  be  traced  to  quality  control  proce¬ 
dures  (Hollingsworth  et  al .  1985).  Gutowski  and  Hoffman  (1985)  have  proposed 
a  procedure  to  lessen  this  sensitivity  by  adjusting  the  weight  given  to 
suspect  observations. 


1 . 2  Purpose  of  the  Present  Experiments 


The  purpose  of  the  experiments  reported  here  is  three -fold:  to  evaluate 
the  impact  of  satellite  data  on  the  AFGL  data  assimilation  system,  to  assess 
the  effect  of  denying  part  or  all  of  the  conventional  data,  and  to  test  the 
quality  of  the  AFGL  system.  The  first  and  last  goals  are  in  fact  closely 
linked.  A  complete  evaluation  of  the  impact  of  satellite  data  on  NWP  would 
require  resources  well  beyond  those  available  to  this  project.  This  more 
limited  work  will  show  how  this  particular  assimilation  system  handles  a 
particular  set  of  satellite  data,  in  a  small  number  of  cases.  Hence  it  is 
likely  to  tell  us  more  about  the  performance  of  the  data  assimilation  system 
than  the  usefulness  of  satellite  data  in  NWP.  We  may  be  able  to  see  whether 
our  results  are  consistent  with  those  of  other,  more  extensive  studies,  but  we 
should  be  cautious  of  drawing  any  definite  conclusions  on  the  basis  of  the 
small  sample  that  will  be  available  to  us. 


While  performing  the  assimilation  experiments  described  below,  we  have 
determined  that  the  analysis  system  is  performing  reasonably.  The  main  vali¬ 
dation  of  the  performance  of  the  assimilation  system  comes  from  the  results  of 
the  STATSAT  OSF.  described  below.  The  input  data  for  this  experiment  closely 
parallels  that  used  by  NMC  to  produce  its  FGGE  Level  III -a  analyses. 
Comparison  of  NMC  Ill-a  analyses  with  those  from  the  STATSAT  experiment 
confirms  that  the  assimilation  system  is  performing  adequately  except  for 


some  large  differences  at  the  surface.  (As  noted  below,  no  use  is  made  of 
surface  observations  in  the  analysis.) 


To  test  the  sensitivity  of  the  assimilation  system  to  satellite  data, 
a  second  experiment,  called  NOSAT,  is  performed,  with  all  satellite  data 
removed.  The  extent  of  the  usefulness  of  satellite  data  has  been  shown  by 
previous  research,  but  this  test  gives  us  an  idea  of  the  kind  of  sensitivity 
that  can  be  expected  from  other  experiments,  to  be  performed  later,  in  which 
different  satellite  retrieval  techniques  are  compared. 

In  the  last  two  experiments,  the  effect  of  denying  conventional  data  is 
studied.  First,  in  the  NOCON  experiment,  all  the  conventional  data  are  re¬ 
moved  from  the  data  set.  This  gives  an  indication  as  to  what  extent  a  purely 
space -based  system  can  satisfy  the  data  requirements  for  NWP,  were  conven¬ 
tional  data  to  become  unavailable.  Finally,  a  less  drastic  situation  is 
examined  in  experiment  NOCOR ,  in  which  conventional  data  are  denied  over  a 
region  of  the  globe,  specifically  over  Europe  and  the  USSR. 


1 • 3  The  AFGL  Forecas t /Anal vsis  System 


The  series  of  6D  data  assimilation  experiments  described  here  make  use  o 
existing  computer  codes  and  data  bases  at  AFGL.  The  assimilation  cycle  con¬ 
sists  of  a  sequence  of  three  major  steps:  analysis,  normal  mode  initializa¬ 
tion,  and  forward  integration  of  the  initialized  state  to  the  next  analysis 
time.  Some  pre-/post-processing  of  the  data  may  occur  between  the  major 
steps.  An  entire  assimilation  run  is  a  repetition  of  this  sequence  until  an 
initialized  analysis  is  obtained  at  the  ending  time. 


Optimal  interpolation  (01)  provides  the  mechanism  for  obtaining  regularl 
gridded  initial  conditions,  i.e.,  analyses,  from  incomplete,  irregularly 
spaced  data.  The  AFGL  Statistical  Analysis  Program  (ASAP),  is  actually  com¬ 
posed  of  four  individual  programs.  The  ASAP  01  was  developed  bv  SASC  for 
AFOI./LYP  and  is  documented  in  a  series  of  reports  by  Norquist  and  others 
(Norquist,  1982b,  1981,  1986,  1986;  Halberstam  et  al.,  1986).  The  ASAP  01  i  j, 
based  on  the  NMC  assimilation  system,  as  reported  in  the  literature  and  in 
personal  communications;  this  system  was  thoroughly  redesigned  and  recoded  hv 
SASC  personnel  According  to  Norquist  (1986),  ASAP  was  developed  originally 
from  the  1979  multivariate  01  procedure  as  described  by  Bergman  (19/0)  an,|  ),v 
McPherson  et  al  .  (19/9),  with  some  assistance  from  NMC  p»  rsonnel  (Morone , 


1983,  private  communication).  The  ASAP  01  is  a  multivariate  analysis  of 
height  and  wind  components  and  a  univariate  analysis  of  relative  humidity, 
both  in  model  sigma  layers.  The  equations  for  these  weights  as  well  as  the 
computation  of  the  horizontal  and  vertical  correlation  functions  follow 
Bergman  (1979) .  The  analysis  error  evolves  according  to  simple  rules  (Nor- 
quist,  1986).  The  great  circle  distance  method  for  correlation  functions 
equatorward  of  70°  latitude  is  included  as  described  by  Dey  and  Morone  (1989) 
without  changing  the  Bergman  formulation  (including  map  factor)  for  latitudes 
poleward  of  70°  latitude. 

Data  used  by  the  height-wind  analysis  include  Type  1  observations  (radio¬ 
sondes,  pibals,  etc.),  Type  2  observations  (aircraft),  Type  4  observations 
(sate  Hite  -  retrieved  temperatures  or  thicknesses)  and  Type  6  observations 
(cloud  drift  winds  (CDWs)).  The  Type  3  surface  observations  are  not  used  at 
all.  This  implies  that  satellite  "heights"  are  anchored  only  by  the  6  h  fore¬ 
cast  in  regions  where  radiosondes  are  absent  or  denied.  The  moisture  analysis 
used  in  the  experiments  reported  here  uses  only  Type  1  data.  Consequently, 
during  the  N0C0N  experiment  there  was  no  moisture  analysis.  In  all  experi¬ 
ments,  except  for  the  three-day  preliminary  assimilations,  the  CDW  data  (Type 
6  data)  were  combined  (i.e.,  locally  averaged)  into  super-obs.  There  are  two 
principal  reasons  for  doing  this:  First,  to  limit  the  total  number  of  obser¬ 
vations,  so  that  computer  memory  restrictions  are  not  exceeded,  and  second, 
the  CDW  errors  are  strongly  correlated  horizontally  because  the  main  error 
source  is  due  to  height  assignment  (McPherson,  1984).  Because  of  new  quality 
control  codes  inserted  by  the  NASA/NMC  Special  Effort  the  quality  control 
translation  tables  for  Type  6  data  in  ASAP  were  altered.  The  only  other 
change  made  to  ASAP  for  these  experiments  was  to  alter  the  satellite  height 
observational  error  statistics  (Table  1) . 
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The  normal  mode  initialization  (NMI)  is  a  part  of  the  forecasting  system 
which  adjusts  the  initial  data  in  such  a  way  that  undesirable  gravity  waves  do 
not  grow  in  the  forecast.  The  AFGL  NMI  was  developed  by  SASC,  based  on  the 
NMC  NMI.  The  NMC  NMI  is  described  by  Ballish  (1980).  The  AFGL  version,  much 
of  which  is  taken  intact  from  the  NMC  codes,  is  discussed  by  Norquist  (1982a) 
and  Tung  (1983).  The  NMI  program  is  actually  two  programs,  one  which  calcu¬ 
lates  the  normal  modes  (i.e.,  eigensolutions  of  the  discrete  linearized  model 
equations)  and  one  which  performs  two  iterations  of  the  Machenhauer  initiali¬ 
zation  procedure  which  sets  the  time  tendencies  of  the  gravity  modes  approxi¬ 
mately  to  zero.  We  altered  the  Machenhauer  initialization  procedure  to  make 
use  of  the  tendencies  calculated  by  the  AFGL  GSM.  To  accomplish  this  we 
altered  the  GSM  to  write  out  tendencies  if  desired.  We  then  developed  a  pro¬ 
gram  to  add  in  the  linear  tendency  terms,  not  explicitly  calculated  by  the  GSM 
and  perform  a  single  Machenhauer  projection.  The  GSM  tendency  and  Machenhauer 
projection  calculations  are  repeated  twice  to  obtain  a  complete  initialization. 
The  NMC  Machenhauer  projection  codes  were  used  with  no  alterations.  The  pro¬ 
cedure  was  tested  by  temporarily  making  small  changes  to  the  AFGL  GSM  so  that 
its  physical  constants  and  parameterizations  would  agree  with  the  NMC  tendency 
calculation  used  in  the  previous  NMI.  Extremely  good  agreement  was  obtained. 

The  AFGL  global  spectral  model  (GSM)  is  based  on  the  NMC  GSM  designed  by 
Sela  (1980).  For  the  version  used  here,  the  physics  routines  are  taken  almost, 
intact  from  NMC  (circa  1983).  The  hydrodynamics,  i.e.,  the  nonadiabatic , 
inviscid  dynamics  including  vertical  and  horizontal  ad'rection,  time  stepping, 
and  transformations  between  spectral  and  physical  space,  were  completely  re¬ 
designed,  as  documented  by  Brenner  et  al .  (1982,  1989).  As  mentioned  above, 
there  are  only  minor  differences  between  the  AFGL  and  NMC  GSMs ,  at  least  as 
far  as  the  calculation  of  the  dry  tendencies. 

There  arc  a  number  of  parameters  in  the  assimilation  cvcle  codes  that  can 
be  adjusted.  Typically,  the  parameters  have  the  same  values  as  used  bv 
Brenner  et  al.  (1989)  and  Halberstam  et  al.  (1989).  Briefly,  the  spectral 
resolution  of  the  forecast  model  is  rhomboidal  30.  The  Gauss i an  grid  ot  the 
forecast  model  (analysis)  contains  /9  x  9b  (92  \  f>9)  latitude  lonp.itud. 
points.  There  are  12  layers,  the  first  (topi  9  of  which  have  no  moistui, 

The  sigma  interfaces  are  at  0.00.  0.09,  0.10.  0 .  1  9 .  0.30,  ().;’•■>_  0.(0.  <>.>■>. 
0.90,  0.99,  0.80,  0.929,  and  1.00.  The  time  scheme  used  i..  centered  m  ■ 
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implicit  with  a  time  step  of  17.25  minutes  and  a  Robert  time  filter  is  appiitd 


with  a  constant  of  0.04.  A  spectral  diffusion  coefficient  of  6  x  10 


(6  x  lO^^m'^s’^)  is  applied  during  the  forecasts  (assimilation  cycle)  to  1 


prognostic  variables  except  for  moisture.  In  the  NMI,  two  Machenauer  itera¬ 
tions  are  applied  to  modes  for  the  four  largest  equivalent  depths  which  have 
periods  less  than  or  equal  to  48  h. 


Except  for  the  correction  of  a  few  minor  errors  discovered  by  scientists 
at  AFGL/LYP  during  the  course  of  the  contract,  no  substantive  changes  were 
made  to  the  assimilation  system  other  than  those  noted.  Some  additional  diag¬ 
nostic  capabilities  were  added.  These  additions  include  a  file  of  rejected 
observations  from  the  ASAP  01  and  the  calculation  of  divergence,  vorticity  and 
vertical  velocity  all  in  pressure  coordinates,  within  the  post-processor. 


1 • 4  Methodolot 


Each  impact  test  consists  of  assimilation  runs  for  two  7-day  periods 
during  the  FCGE  SOPs :  February  8  through  15,  1979,  and  June  17  through  24, 
1979.  The  SOP  I  and  SOP  II  periods  are  treated  in  the  same  fashion.’'  Each 
assimilation  run  consists  of  a  series  of  assimilation  cycles,  and  each  cycle 
in  turn  is  made  up  of  a  6 -hour  forecast  that  serves  as  a  first  guess  for  the 
analysis,  an  optimum  interpolation  analysis  which  combines  the  first  guess 


fields  with  the  observations,  and  a  nonlinear  normal  mode  initialization  of 


the  analysis.  The  initialized  analysis  is  the  starting  point  for  the  next 
6-hour  forecast,  which  is  then  used  as  the  first  guess  of  the  subsequent 
assimilation  cycle.  The  forecast  model  used  for  the  6-hour  forecast  is  the 


full  CSM.  The  same  model"  is  also  used  to  produce  96  h  forecasts  starting 


from  days  3.  5,  and  7  of  the  assimilation  runs. 


The  initial  conditions  for  the  first  assimilation  cycle  of  each  assimi¬ 


lation  run  starting  on  the  same  date  is  the  same  for  all  OSKs.  One  could  us( 
an  initialized  Ill-a  or  111-b  analysis  for  that  purpose,  but  that  would  have 


Observing  error  standard  deviations  for  satellite  heights  are  specified 


differently  for  each  period,  however  (see  Table  1). 


Different  values  are  used  for  the  diffusion  coefficients. 
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the  disadvantage  that,  during  the  initial  period  of  each  OSE,  the  system  would 
be  undergoing  adjustments  because  the  level  III  analyses  are  not  entirely 
compatible  with  the  assimilation  system  used  in  the  OSE.  To  avoid  that 
complication,  we  have  performed  a  3-day  assimilation  run  once  for  each  SOP 
period,  starting  from  an  initialized  level  III  NMC  analysis,  with  the  full 
FGGE  data  base  (i.e.,  similar  to  the  STATSAT  OSE  except  that  the  CDWs  were  not 
super - obbed) .  The  final  initialized  results  from  these  two  "spin-up"  assimi¬ 
lation  runs  then  serve  as  the  starting  point  for  all  OSEs  reported  here. 

Independent  analyses  for  the  same  time  period,  performed  by  NMC  using 
level  11-a  data,  provide  some  benchmarks  for  the  interpretation  of  analysis 
skill  and  characteristics.  We  directly  compare  our  analyses  with  the  corres¬ 
ponding  level  III  analyses,  computing  mean  and  RMS  differences.  In  addition, 
the  data  fitting  characteristics,  smoothness,  and  meteorological  realism  of 
the  different  analyses  are  compared  with  each  other.  Finally,  a  measure  of 
the  quality  of  the  analyses  is  given  by  the  skill  of  forecasts  made  from  them. 
We  evaluate  these  forecasts  against  the  independent  level  III  analyses  of  NMC. 

2.  STATSAT  EXPERIMENT 

The  first  experiment,  named  STATSAT,  uses  all  the  available  upper  air 
data  in  the  FGGE  dataset.  This  includes  satellite  temperature  soundings  pro¬ 
vided  by  NESDIS,  but  not  satellite  moisture  soundings.  The  retrieval  method 
used  statistical  regressions  between  temperature  profiles  and  measured 
radiances.  This  is  the  same  dataset  as  was  used  by  ECMWF  for  their  FGGE 
analyses,  and  essentially  the  same  as  was  used  by  NMC  for  their  operational 
analyses.  The  differences  that  can  be  observed  between  the  STATSAT  analyses 
and  the  NMC  or  ECMWF  analyses  are  thus  mainly  due  to  differences  in  the 
analysis/forecasting  systems,  including  differences  in  the  data  selection 
algorithm.  We  will  mainly  compare  STATSAT  and  NMC  uninitialized  analyses. 
Except  for  differences  at  the  lower  levels,  which  may  be  due  to  the  fact  that 
the  AFGL  analysis  system  does  not  use  surface  observations,  the  STATSAT  and. 
NMC  analyses  appear  to  be  quite  similar  at  first  glance.  A  more  detailed 
examination  reveals  differences  which  can,  occasionally,  be  quite  miliM  ,mt  i.d 
and  synoptical ly  significant. 
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February 

In  the  Northern  Hemisphere  winter,  the  500  mb  height  differences  reach 
150  to  200  m .  Some  regions  appear  more  prone  to  large  differences.  The  most 
striking  differences  are  associated  with  a  deep,  quasi -stationary  trough  in 

the  Gulf  of  Alaska.  The  shape  and  phase  of  this  trough  are  often  different. 

The  main  baroclinic  zone  in  the  trough  tends  to  be  further  south  in  the  STATSAT 
analyses,  and  the  small  waves  that  are  superimposed  on  the  main  trough  (and 
the  following  broad  ridge  over  the  Rockies)  have  little  in  common  (Fig.  1). 

In  the  Eastern  Pacific,  off  the  coast  of  Central  America,  the  NMC 
analyses  show  a  broad  region  of  low  pressure  which  seems  to  be  absent  in  the 
STATSAT  analyses.  Differences  in  the  phase  and  shape  of  the  flow  are  also 
evident  over  northern  Europe  throughout  the  winter  period. 

These  differences  are  even  more  striking  at  1000  mb.  In  fact,  the 
STATSAT  and  NMC  analyses  of  the  1000  mb  flow  can  be  remarkably  different. 

For  example,  on  February  8,  12Z,  the  NMC  analysis  shows  the  flow  to  be 

parallel  to  the  northwest  coast  of  North  America,  while  in  the  STATSAT 

analysis  the  flow  crosses  the  coast  (Fig.  2). 

On  10  February  00  GMT,  the  low  over  Finland  has  a  depth  of  -17A  m  in  the 
NMC  analysis,  but  only  -8A  m  in  the  STATSAT  analysis  (Fig.  3).  The  center  of 
the  low  is  also  displaced,  producing  quite  a  different  flow  over  the  Scandina¬ 
vian  peninsula. 

The  differences  between  STATSAT  and  NMC  analyses  in  February  are  larger 
in  the  southern  hemisphere,  frequently  exceeding  250  rn,  both  at  500  and  1000 
mb.  The  flow  generally  appears  slightly  more  zonal,  especially  at  1000  mb, 
and  the  gradients  somewhat  weaker  in  the  STATSAT  analyses.  A  striking 
difference  is  the  absence,  in  the  STATSAT  analysis  of  February  13,  of  an  in¬ 
tense  low  in  the  south  of  the  Indian  Ocean  (Fig.  A).  This  feature  is  present 
both  in  the  NMC  and  in  the  ECMWF  analyses,  and  seems  to  have  evolved  from  a 
small  scale  tropical  .storm.  There  is  only  the  hint  of  a  trough  in  t  he  STATSAT 
ana  1 ys i s . 


Over  t  lie  Ant  a  ret  ic  continent  (hiring  t  he  whole  February  period,  the  Slid  mi. 
STATSAT  analysis  is  .about  200  m  higher  than  the  NMC  analysis  The  differenct- 
are  also  large  at  1000  mb  in  that  region,  but  not  so  systematic. 


Some  differences  are  associated  with  orographic  features.  The  NMC  analy¬ 
ses  have  a  localized  stationary  high  along  the  coast  of  Chili,  upwind  of  the 
Andies,  more  pronounced  at  00Z  than  at  12Z.  They  also  show  odd,  persistent 
small  scale  features  over  the  Red  Sea,  Gulf  of  Arabia  and  Caspian  Sea  (more 
apparent  in  the  difference  fields).  Both  are  absent  in  the  STATSAT  analyses. 

We  have  examined  the  relative  humidity  fields  mostly  at  850  mb  over  the 
north  Atlantic  region.  The  differences  between  the  STATSAT  and  NMC  analyses 
are  fairly  large,  often  exceeding  50%.  They  are  often  related  to  differences 
in  the  synoptic  patterns.  The  STATSAT  relative  humidity  analyses  tend  to  show 
more  small  scale  structure  over  North  America,  and  to  be  drier  over  the  sub¬ 
tropical  Atlantic,  near  the  African  coast  (Fig.  5). 

June 

In  June,  the  500  mb  height  differences  are  somewhat  smaller  in  the  North¬ 
ern  Hemisphere,  rarely  exceeding  100  m,  as  can  be  expected  from  the  weaker 
summer  circulation.  One  interesting  exception  is  on  21  June,  00  GMT.  In  the 
STATSAT  analysis  the  trough  near  the  east  coast  of  North  America  extends  east 
into  the  Atlantic,  while  the  NMC  analysis  has  its  maximum  high  there  (Fig.  6). 

The  circular  pattern  in  the  difference  map  suggests  that  the  anomaly  may 
be  due  to  a  different  data  selection.  An  examination  of  the  data  file 
revealed  that,  on  that  day,  a  radiosounding  was  taken  by  ship  UZGX  at  36. 3N, 
57. 4W,  very  close  to  the  center  of  the  difference  pattern.  The  observed  500 
mb  height  was  5840  m.  The  STATSAT  analyzed  height  is  5810  m,  whereas  the  NMC 
height  is  6000  m,  much  further  from  the  observed  value.  In  this  case,  the 
ECMWF  analysis  falls  between  the  STATSAT  and  NMC  fields,  with  a  height  of 
about  5850  m.  Thus  it  appears  that,  either  this  sounding  was  not  available  to 
the  NMC  operational  analysis  system,  or  it  rejected  the  information,  while 
both  the  STATSAT  and  ECMWF  took  it  into  account . 

At  1000  inb ,  the  differences  are  also  fairly  small.  There  is  a  tendency 
for  the  STATSAT  analyses  to  be  higher  than  the  NMC  analyses  over  the  conti¬ 
nents,  and  lower  over  the.  oceans  (Fig.  7).  Essentially,  the  STATSAT  oceanic 
highs  are  not  as  strong  as  in  the  NMC  analyses. 


Over  Antarctica,  the  June  STATSAT  analyses  are  systematically  higher  than 
the  NMC  analyses,  by  up  to  400  m  at  500  mb  (Fig.  8).  This  means  that  the 
polar  vortex  is  less  intense  in  the  STATSAT  analyses  than  in  the  NMC  ones.  In 
addition,  large  differences  in  the  phase  and  amplitude  of  the  waves  make  the 
two  southern  hemisphere  analyses  noticeably  different  (Fig. 9). 

Forecasts . 

The  first  STATSAT  forecasts  of  the  series  can  be  evaluated  either  against 
the  NMC  analyses,  or  against  the  STATSAT  analyses  themselves.  The  later 
forecasts  can  only  be  compared  to  the  NMC  analyses  since  STATSAT  analyses  are 
not  available  beyond  February  15  or  June  24.  Hence  we  will  mostly  compare  the 
forecasts  to  the  NMC  analyses  and,  unless  otherwise  specified,  we  will  write 
"forecast  errors"  for  the  differences  between  the  STATSAT  forecasts  and  the 
NMC  analyses. 

At  the  beginning,  the  forecast  errors  are  mainly  related  to  differences 
between  the  initial  (STATSAT)  analysis  and  the  NMC  data.  For  example,  in  the 
12  hr  forecast  from  February  11,  00Z,  the  widespread  negative  errors  in  the 
eastern  Pacific  and  western  Atlantic  (Fig.  10)  are  clearly  amplifications  of 
similar  negative  differences  in  the  analyses  (compare  to  Fig.  1(c)). 

The  evolution  of  differences  during  the  assimilation  cycle  and  forecasts 
is  displayed  in  Fig.  11.  The  dot-dashed  line  shows  the  evolution  of  the  root 
mean  square  (rms)  difference  between  the  STATSAT  and  the  NMC  500  mb  height 
analyses.  The  solid  lines  are  the  rms  STATSAT  forecast  errors  ( forecast -NMC 
analysis),  also  at  500  mb.  The  first  and  last  forecasts  of  the  series  are 
shown.  Finally,  the  dotted  line  is  the  rms  difference  between  the  STATSAT 
forecast  and  the  corresponding  STATSAT  analysis.  Each  hemisphere  and  season 
is  plotted  separately.  These  plots  confirm  what  has  been  found  from  the 
examination  of  the  maps.  The  analysis  differences  are  larger  in  the  Southern 
Hemisphere  than  in  the  Northern  Hemisphere,  and  larger  in  the  winter  than  in 
the  summer.  The  forecast  errors  grow  somewhat  more  slowly  in  the  summer  than 
in  the  winter.  After  48  hours,  in  the  Northern  Hemisphere,  the  rms  forecast 
errors  become  nearly  independent  of  the  reference  analysis.  In  the  Southern 
Hemisphere,  by  contrast,  the  STATSAT  forecasts  remain  closer  to  the  STATSAT 
analyses  than  to  the  NMC  analyses  throughout  the  length  of  the  forecasts 
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Systematically,  all  the  STATSAT  forecasts  are  drier  than  the  NMC  analyses 
over  the  sub-tropical  Atlantic  (between  10  and  30N) .  Since  few  data  exist  in 
that  region,  it  is  not  clear  what  the  truth  is.  The  STATSAT  analyses  are 
drier  too.  These  differences  may  be  due  to  some  differences  in  the  physical 
parameterizations ,  perhaps  the  Kuo  convection,  or  to  differences  in  the 
prescribed  sea  surface  temperature. 

3 .  NOSAT  EXPERIMENT 

In  the  NOSAT  assimilation  experiment  all  satellite  data  are  removed  from 
the  dataset.  Only  conventional  data  are  used.  Thus  we  expect  differences 
between  the  NOSAT  and  STATSAT  analyses  mainly  over  the  oceans  and  the  southern 
hemisphere.  Over  the  Northern  Hemisphere  continents,  where  conventional  data 
are  numerous,  differences  are  expected  only  to  the  extent  that  the  first 
guess,  which  advects  the  errors  from  the  data -sparse  regions,  influences  the 
analyses . 


February 

As  can  be  seen  in  Fig.  12,  the  differences  between  the  two  analyses  grow 
during  the  period.  In  February,  in  the  Northern  Hemisphere,  the  differences 
remain  fairly  small,  rarely  exceeding  100  m,  and  reach  their  maximum  amplitude 
after  about  4  days  of  data  assimilation.  The  largest  differences  occur  over 
the  oceans,  but  some  propagation  onto  the  continents  can  be  observed, 
especially  over  North  America  (Fig.  13). 

When  compared  to  the  NMC  analyses,  the  NOSAT  fields  exhibit  similar  kinds 
of  differences  as  the  STATSAT  fields  do,  but  usually  somewhat  larger.  For 
example,  there  is  the  same  tendency  to  spread  the  baroclinic  zone  further 
south  in  the  Pacific  trough,  but  now  this  tendency  can  also  be  seen  in  the 
Atlantic  (Fig.  14).  Usually,  the  STATSAT  analyses  are  closer  to  the  NOSAT 
analyses  in  the  Northern  Hemisphere  than  to  the  NMC  analyses.  There  are  a  f ev. 
exceptions:  on  February  14,  (he  NOSAT  analysis  has  a  small  ridge  over  the  b.r, 
of  Biscay,  which  is  absent  in  the  STATSAT  and  NMC  analyses,  and  the  STATSAT 
low  near  Kamchatka  is  similar  to  the  NMC  one,  while  it  is  split  in  the  NOSAT 
analysis . 

Since  the  satellite  moisture  data  included  in  the  FG'G'E  dataset  are  not 
used,  the  differences  in  relative  humidity  between  the  NOSAT  and  STATSAT 


analyses  are  due  only  to  the  different  temperature  fields  and  are  small 
throughout  the  assimilation  period. 

The  Southern  Hemisphere  differences  between  the  NOSAT  and  STATSAT 
analyses  keep  growing  throughout  the  assimilation  period,  reaching  values  of 
300  m  on  February  15.  They  do  stay  small  over  the  land  masses,  however,  even 
over  Antarctica  (Fig.  15).  The  deep  low  analyzed  by  NMC  in  the  Indian  Ocean 
around  February  13  is  also  completely  absent  from  the  NOSAT  analysis.  The 
flow  is  also  noticeably  more  zonal  than  in  the  NMC  analyses,  more  so  than  the 
STATSAT  analyses.  For  example,  on  February  9,  00Z,  all  highs  of  the  NMC 
analysis  are  higher  and  most  lows  are  lower  than  in  the  NOSAT  analysis,  indi¬ 
cating  that  the  NOSAT  waves  have  smaller  amplitudes. 

June 

In  June,  the  Northern  Hemisphere  analyses  remain  very  similar  throughout 
the  assimilation  period,  with  height  differences  barely  reaching  50  m.  In  the 
southern  hemisphere,  on  the  other  hand,  differences  already  exceed  100  m  after 
the  first  day  of  assimilation,  and  soon  reach  more  than  300  m.  By  June  20  the 
two  analyses  begin  to  diverge,  with  the  STATSAT  fields  remaining  much  closer 
to  the  NMC  analyses  than  to  the  NOSAT  analyses.  This  is  especially  true 
southwest  of  Australia,  where  on  22  June  the  NOSAT  analysis  shows  a  ridge 
where  both  the  STATSAT  and  NMC  analyses  have  a  trough  (Fig.  16).  After  that 
point  the  STATSAT  and  NOSAT  analyses  have  little  in  common.  Most  of  the 
differences  between  the  two  analyses  occur  in  the  regions  where  there  are  no 
radiosounding  stations.  This  can  be  seen  on  Fig.  17,  where  the  station  posi¬ 
tions  are  indicated  on  the  500  mb  difference  map  for  June  21.  Only  at  two 
stations  does  the  difference  reach  or  exceed  80  m:  Marion  Island  (46. 9S, 

37. 9E)  and  Gough  Island  (40. 3S,  8.9W).  Table  2  shows  that,  in  both  cases,  the 
STATSAT  analysis  is  closer  to  the  observed  value  than  the  NOSAT  analysis. 

We  checked  the  rejected  data  files  and  found  that  both  height  and  wind 
data  at  Gough  Island  were  rejected  by  the  gross  check  oi  the  NOSAT  analysis, 
meaning  that  the  data  were  considered  too  far  from  the  first  guess  to  be 
used.  At  Marion  Island  the  NOSAT  analysis  rejected  the  wind  data.  In  the 
STATSAT  experiment  all  these  data  were  retained. 
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Table  2 


Height  of  the  500 

mb  surface 

at  2  Southern 

Hemisphere  island  stations. 

STATSAT 

NOSAT 

Observed 

Marion  Island 

5540 

5450 

5590 

Gough  Island 

5520 

5600 

5520 

Toward  the  end  of  the  assimilation  period,  some  rather  large  differences  begin 
to  appear  even  in  regions  where  radiosonde  data  are  available.  On  June  24 
(Fig.  18) ,  large  differences  can  be  seen  in  the  500  mb  fields  near  New  Zea¬ 
land,  despite  three  existing  radiosonde  measurements.  Table  3,  which  gives 
the  observed  and  analyzed  500  mb  heights,  again  shows  that  the  STATSAT  anal¬ 
ysis  is  closer  to  the  observations  than  the  NOSAT  analysis.  The  Macquarie 
Island  data  was  rejected  by  the  NOSAT  analysis.  This  suggests  that,  at  least 
in  the  Southern  Hemisphere,  satellite  data  are  beneficial  even  where 
conventional  data  exist. 


Table  3 

Height  of  the  500  mb  surface  at  3  stations. 


STATSAT 

NOSAT 

Observed 

Christchurch 

5690 

5540 

5710 

Invercargill 

5650 

5440 

56  70 

Macquarie  I si . 

5280 

5180 

5240 

Forecasts 

As  in  the  case  of  the  STATSAT  forecasts,  the  differences  between  the 
NOSAT  forecasts  and  the  NMC  analyses  can,  in  the  short  range,  often  be  traced 
to  differences  in  the  initial  analyses.  In  the  Northern  Hemisphere,  the  NOSAT 
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forecasts  are  quite  similar  to  the  STATSAT  forecasts.  In  fact,  comparing 
Fig.  19  to  Fig.  11,  the  Northern  Hemisphere  rms  differences  for  the  NOSAT 
experiment  are  almost  indistinguishable  from  those  for  the  STATSAT  experiment  , 
especially  in  the  summer.  The  96  hr  500  mb  and  the  72  hr  100  mb  forecasts 
would  generally  be  considered  poor  forecasts. 

In  the  Southern  Hemisphere,  the  NOSAT  forecasts  quickly  differ  from  the 
STATSAT  forecasts.  As  early  as  72  hrs  into  the  forecasts,  the  Southern  Hemis¬ 
phere  fields  are  so  different  from  the  NMC  analyses  that  they  can  be  con¬ 
sidered  useless.  By  that  time,  the  range  of  the  errors  is  larger  than  the 
range  of  variation  of  the  fields.  Compared  to  the  NOSAT  analyses,  however, 
these  same  forecasts  remain  quite  "good"  (i.e.  similar  to  the  analyses), 
sometimes  up  to  96  hrs.  A  typical  case  is  the  48  hr  Southern  Hemisphere 
forecast  from  June  20,  00Z  (Fig.  20).  Even  though  on  June  20  the  two  analyses 
are  fairly  similar,  by  June  22  the  NOSAT  analysis  shows  a  strong  ridge  between 
Africa  and  Australia,  while  a  trough  remains  in  the  STATSAT  analysis,  as  well 
as  in  the  NMC  and  ECMWF  analyses.  A  very  similar  ridge  develops  in  the  48  hr 
NOSAT  forecast  from  June  20.  Without  the  satellite  data,  the  NOSAT  assimila¬ 
tion  is  dominated  in  the  Southern  Hemisphere  by  the  forecast. 

4.  NOCON  EXPERIMENT 

The  NOCON  experiment  is  designed  to  study  the  effect  of  a  completely 
space-based  observing  system.  All  the  conventional  data  are  removed  from  the 
FGGE  dataset.  Only  satellite  data  are  used,  but  these  are  used  over  the  con¬ 
tinents  as  well  as  over  the  oceans,  in  contrast  to  the  STATSAT  experiments  in 
which  satellite  data  are  used  only  over  the  oceans.  Obviously  the  biggest 
effect  is  expected  over  the  continents.  However,  it  should  be  remembered  that 
the  available  satellite  soundings  only  provide  temperatures  or,  equivalently, 
thicknesses.  The  height  of  a  reference  pressure  level  is  also  needed  to  com¬ 
pute  the  height  of  all  the  pressure  levels.  In  our  experiments  the  reference 
height  (height  of  the  lowest  standard  pressure  level  above  the  ground)  is 
provided  by  the  forecast  first  guess.  In  the  NOCON  experiment  we  expect  that 
errors  in  this  forecast  will  eventually  corrupt  the  entire  analysis. 


February, 


In  Che  Northern  Hemisphere,  the  500  mb  differences  between  the  NOCON 
analyses  and  the  STATSAT  analyses  keep  growing  throughout  the  assimilation 
period.  On  February  13,  the  fields  are  noticeably  diff  rent  over  northern 
Europe  (Fig.  21),  and  by  February  14  the  differences  are  large  throughout  the 

Northern  Hemisphere.  On  February  15  the  differences  reach  more  than  350  m  at 

one  point  (Fig.  22).  They  do  not  exceed  100  m  over  North  America,  however.  A 
similar  behavior  is  observed  at  1000  mb,  also  with  a  somewhat  smaller  ampli¬ 
tude  in  Eurasia  (250  m) ,  and  larger  in  North  America  (150  m) .  One  week  of 

data  assimilation  is  not  sufficient  to  determine  how  large  the  differences 

between  the  analyses  of  this  space-based  system  and  the  STATSAT  analyses  would 
eventually  become . 

While  the  overall  patterns  of  the  relative  humidity  field  are  fairly 
similar  in  the  two  analyses,  large  small-scale  differences  abound  (Fig.  23). 

In  the  Southern  Hemisphere  the  differences  remain  much  smaller  than  in 
the  Northern  Hemisphere,  except  over  the  polar  cap  where  the  500  mb  height 
difference  reaches  200  m  on  February  15. 


June 

In  the  Northern  Hemisphere,  the  June  NOCON  analyses  differ  from  the 
STATSAT  analyses  by  a  smaller  amount  than  in  February,  and  the  differences 
stay  mostly  confined  to  the  continental  areas  (Fig.  24).  The  differences  are 
very  similar  at  500  and  1000  mb.  In  the  Southern  Hemisphere,  on  the  other 
hand,  the  difference  pattern  is  striking.  After  one  day  of  assimilation  (June 
18),  an  area  of  negative  difference  has  appeared,  which  covers  almost  exactly 
the  Antarctic  continent  (Fig.  25).  This  pattern  grows  in  strength  and  area 
until,  on  June  24,  it  reaches  almost  450  m.  Nearly  the  opposite  occurs  at 
1000  mb,  with  the  difference  field  being  mostly  positive  over  Antarctica. 
Obviously,  since  the  surface  of  the  continent  is  far  above  the  1000  mb  level, 
this  positive  difference  may  merely  indicate  a  different  lapse  rate  above  the 
surface  in  the  two  analyses. 
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Forecasts 


All  the  NOCON  forecasts  behave  in  a  similar  fashion,  compared  to  the 
STATSAT  forecasts.  We  will  take  the  forecast  from  June  20  as  an  example.  At 
the  beginning  of  the  forecast  the  NOCON  500  mb  forecast  errors  (NOCON  forecast 
minus  NMC  analysis)  are  similar  to  the  STATSAT  forecast  errors,  but  slightly 
larger.  The  two  forecasts  start  diverging  after  48  hrs  in  the  Northern  Hemi¬ 
sphere,  with  phase  differences  noticeable  over  North  America  and  Scandinavia. 
The  differences  keep  growing  and,  at  96  hrs,  the  two  forecasts,  while  still 
keeping  a  family  resemblance,  are  different  in  all  details  (Fig.  26). 

At  1000  mb  the  differences  appear  sooner.  Already  at  24  hrs  differences 
are  visible  over  North  America.  At  48  hrs  a  low  present  over  Canada  in  the 
STATSAT  forecast  is  absent  in  the  NOCON  forecast.  By  72  hrs,  the  two  fore¬ 
casts  are  quite  different. 

The  Southern  Hemisphere  forecasts  are  more  similar,  starting  to  diverge 
only  after  72  hrs,  except  over  Antarctica  where  differences  in  the  500  mb 
fields  are  apparent  already  after  24  hrs. 

Since  no  data  was  used  in  the  NOCON  humidity  analyses,  it  is  not  sur¬ 
prising  that  the  NOCON  and  STATSAT  relative  humidity  forecasts  are  very 
different . 

An  interesting  insight  in  the  difference  between  the  STATSAT  and  NOCON 
analyses  is  provided  by  Fig.  27  and  Table  4,  where  two  analyses  and  two  4 -day 
forecasts  for  the  same  day  are  compared.  It  can  be  seen  that  the  NOCON  1000 
mb  analyses  are  as  different  from  the  STATSAT  analyses  as  the  4-day  forecasts 
are  from  their  verifying  analyses.  Figs.  28  and  29  summarize  the  results  of 
our  NOCON - STATSAT  and  NOCON-NMC  comparisons. 


Table  4 

Root  mean  square  differences  between  1000  mb  analyses  and  4-day  forecasts 

for  00  GMT  15  February  1979. 


ANALYSES 

FORECASTS 

NOCON 

STATSAT 

NOCON 

STATSAT 

FORECASTS 

STATSAT 

56.8 

62.5 

48 . 1 

0.0 

NOCON 

49.4 

66.7 

0.0 

ANALYSES 

STATSAT 

51.2 

0.0 

NOCON 

o 

o 

5.  NOCOR  EXPERIMENT 

In  the  NOCOR  experiment  we  investigated  the  effect  of  denying  conven¬ 
tional  data  in  a  limited  region  of  the  globe.  The  area  chosen  covered  Europe 
and  USSR,  as  indicated  on  Fig.  30.  Only  satellite  data  were  used  there. 
Another  difference  with  the  STATSAT  experiment  is  that  satellite  data  were 
used  over  all  continental  areas  as  well  as  over  the  oceans. 

February 

The  differences  between  the  NOCOR  and  STATSAT  analyses  keep  growing 
during  the  whole  assimilation  period  in  the  region  where  the  data  was  denied. 
Over  Siberia  the  500  mb  height  differences  reach  more  than  200  m.  At  the  sail 
time,  differences  propagate  across  the  Pae.il  ie  ocean,  reaching  the  west  coast 
of  North  America  in  about  four  days.  Fig.  3'  shows  the  evolution  of  the 
difference  patterns  during  the  data  assi  in  i  la :  ion  period.  Comp.u./g  Fig.  30(c 
with  Fig.  22,  it  can  be  seen  that,  in  the  Europe/USSR  region,  the  NOCOR 
analysis  is  closer  to  the  STATSAT  analysis  than  the  NOCON  analysis  is,  even 
though  they  both  used  the  same  data  in  that  region.  This  indicates  that  ,  in 


the  NOCOR  analysis,  the  better  quality  of  the  first  guess  slows  the  growth  of 
differences.  As  in  the  NOCON  experiment,  one  week  of  data  assimilation  may 
not  be  sufficient  to  determine  the  asymptotic  behavior  of  this  observing 
system . 

At  1000  mb  the  differences  between  the  NOCOR  and  STATSAT  analyses  stay 
somewhat  smaller  than  at  500  mb,  barely  exceeding  120  m,  and  no  longer  appear 
to  grow  after  13  February.  From  a  synoptic  point  of  view,  the  1000  mb  NOCOR 
and  STATSAT  analyses  are  fairly  similar.  A  typical  example  is  shown  in 
Fig.  31.  The  pressure  gradients  over  northern  and  eastern  Europe  are  dif¬ 
ferent,  and  there  are  some  significant  phase  differences,  but  the  overall 
patterns  are  similar. 

The  differences  in  the  relative  humidity  field  are  mostly  confined  to  the 
region  where  data  were  denied.  The  differences  tend  to  be  of  small  scale,  but 
of  large  amplitude,  often  exceeding  60%. 

June 

In  the  summer,  the  differences  between  the  NOCOR  and  the  STATSAT  analyses 
stay  fairly  small,  and  their  amplitude  no  longer  increases  after  about  3  days 
of  assimilation.  Some  propagation  of  the  differences  into  the  Pacific  area  is 
observed.  The  amplitude  and  phase  of  the  fast-moving  low  East  of  Kamchatka  is 
modified,  resulting  in  differences  of  up  to  120  m  for  the  500  mb  height  in 
that  region  of  the  Pacific  on  22  June  (Fig.  32) 

Forecasts 

The  differences  between  the  NOCOR  and  STATSAT  forecasts  are  in  general 
not  very  large.  They  are  larger  in  winter  than  in  summer  as  expected  from  th< 
more  intense  winter  circulation.  The  propagation  of  the  differences  across 
the  Pacific  is  also  quicker  in  winter  than  in  summer.  In  the  first  forecast 
of  the  series  (starting  February  11),  differences  of  10  in  at  500  mb  appear  on 
the  west  coast  of  north  America  at  2U  hrs .  By  / 2  hrs,  differences  of  about 
equal  magnitude  can  be  seen  at  all  longitudes  (Fig.  33).  In  summer,  on  the 
other  hand,  the  differences  remain  smaller  in  the  western  half  of  the  hemi  - 
sphere  than  in  the  eastern  half  throughout  the  forecast. 

In  the  same  way  as  the  analyses  become  more  different  as  the  ass  imi  1  at  i  <>? 


cycles  progress,  the  forecasts  differences  are  larger  for  those  starting  from 
the  end  of  the  assimilation  periods.  For  example,  the  differences  between  tln- 
NOCOR  forecast  from  February  15  and  the  STATSAT  forecast  starting  on  the  same 
date  are  about  as  large  as  the  STATSAT  forecast  errors  themselves.  Fig.  34 
shows  the  evolution  of  the  forecast  errors  in  time. 

6.  CONCLUSIONS 

The  OSEs  described  here  demonstrate  that  the  AFGL  GDAS  is  operating 
satisfactorily.  In  particular  the  agreement  between  the  STATSAT  and  NMC 
analyzed  500  mb  height  fields  is  typically  40  (50)  m  in  the  Northern 
(Southern)  Hemisphere  (Fig.  11) .  This  is  smaller  than  the  usual  60  or  80  m 
contour  interval  usually  used  to  draw  500  mb  charts.  In  addition,  subjective 
comparison  of  the  500  mb  analyses  revealed  no  unusual  differences.  At  1000  mb 
there  are  however  substantial  differences  due,  no  doubt,  to  different  usage  of 
the  surface  observations.  We  should  compare  initialized  analyses  to  determine1 
if  these  differences  are  important  from  the  point  of  view  of  the  forecast. 
Differences  in  the  Southern  Hemisphere  are  more  substantial.  In  the  Southern 
Hemisphere  there  are  much  fewer  radiosondes  and  the  ana'yses  must  rely  much 
more  on  available  satellite  data  and  the  model  forecasts.  There  are  notable 
differences  between  the  NMC  and  ASAP  procedures  for  using  the  satellite  heigh: 
information  which  might  account  for  the  differences  in  the  Southern  Hemi¬ 
sphere.  In  particular,  ASAP  analyzes  height  while  McPherson  et  al.  (1979) 
analyze  temperature.  Also,  in  the  February  case,  we  used  larger  observational 
error  variances  for  the  satellite  heights  (cf.  Table  1,  p.  6). 

The  NOSAT,  NOCON  and  NOCOR  experiments  delineate  the  impact  of  satellite 
data  on  the  AFGL  GDAS.  Since  only  conventional  data  are  vised  in  NOSAT,  the 
differences  between  NOSAT  and  STATSAT  analyses  are  mainlv  found  over  the 
oceans.  However,  the  first  guess  advects  errors  from  the  data -sparse  to  data- 
rich  regions.  Thus  there  are  substantial  differences  throughout  the  Southern 
Hemisphere  and  smaller  differences  along  the  western  edges  of  the  Northern 
Hemisphere  land  masses.  Forecast  differences  are  small  (large!  in  tlu  North¬ 
ern  (Southern)  Hemisphere.  We  note  that  when  there  is  not  much  data  avail  !*•’  • 
(as  in  the  NOSAT  experiment)  the  resulting  forecasts  may  he  poor  vet  ..give 
very  well  with  the  analyses. 

A  novel  aspect  of  our  conventional  data  denial  experiments  is  that  we 


have  denied  all  Type  1,  2  and  3  data  in  the  NOCON  and  NOCOR  experiments.  In 
other  conventional  data  denial  experiments  reported  in  the  literature  surface 
observations  (Type  3)  are  usually  retained  in  the  data  mix.  In  the  present 
experiments  no  use  is  made  of  surface  observations  to  anchor  the  satellite 
thicknesses.  Without  conventional  data  in  the  Northern  Hemisphere,  the 
quality  of  the  analyses  decays  over  the  7  day  assimilations.  Beyond  7  days 
this  quality  would  probably  continue  to  decay  to  the  level  of  current 
operational  Southern  Hemisphere  analyses.  Such  a  data  system  is  clearly 
inferior  to  the  STATSAT  (full  FGGE)  system.  However,  for  the  first  few  days 
of  data  denial  such  a  system  may  be  adequate.  It  is  clear  from  the  NOCOR 
experiment  that  the  GDAS  is  successful  at  propagating  information  from  the 
data  rich  to  the  data  denied  region.  However,  it  is  also  clear  that  in  the 
winter  errors  propagate  across  the  Pacific  extremely  quickly.  This  highlights 
the  global  nature  of  numerical  weather  prediction. 

Although  we  have  tried  to  make  a  fairly  complete  assessment  of  these  4 
experiments,  some  questions  are  still  open,  and  further  work  will  be 
undertaken  to  answer  them.  It  is  not  clear,  for  example,  whether  comparing 
the  different  forecasts  to  the  NMC  analysis  allows  an  unbiased  evaluation. 

This  will  be  checked  by  computing  the  RMS  differences  between  forecasts  and 
radiosonde  data.  Anomaly  correlations  will  also  be  computed.  Other  points  to 
be  investigated  are  the  effect  of  the  normal  mode  initialization  on  the 
analyzed  fields,  especially  its  effect  on  the  noisiness  of  the  fields,  and  the 
impact  of  the  use  of  satellite  data  on  the  wind  fields. 

The  experiments  reported  here  serve  to  define  the  baseline  for  future 
experiments  planned  and  underway  with  the  AFGL  GDAS  and  to  provide  calibration 
with  impact  studies  conducted  by  other  investigators.  Certainly  the  AFGL 
system  will  be  the  subject  of  future  refinements  and  evolution.  In  the  near 
term  and  of  particular  interest  are  the  following  enhancements  and  planned 
experiments:  Better  physical  parameter izat ions  for  the  GSM  will  be  used  in 

future  data  assimilation  experiments.  We  will  under  this  contract  evaluate 
the  impact  of  these  parameter izat i ons  on  the  GDAS.  We  will  attempt  to  make 
better  use  of  available  moisture  information  in  another  impact  test.  We  will 
use  either  a  level  by  level  approach  following  Norquist  (1086)  to  relate 
auxiliary  information  to  humidity,  or  we  will  relate  3DNEPH  cloud  information 
to  moisture  profiles  using  statistical  methods  which  we  are  currently 


22 


wriijTKwmiJnLWMira^v^iiwv^iWMFMfvyvfSiyUirJIWJWVW^VW’Jtvr^WVIfVW  WW^wwryTVTuran^-Tsn^TvirjTvwvw 


investigating.  The  impact  of  improved  temperature  and  moisture  retrievals 
prepared  by  Susskind  et  al.  (1984)  and  by  AER  will  be  determined  in  two 
i  .  further  data  impact  experiments.  The  experiment  using  the  Susskind  data  is 

now  under  way.  In  addition  minor  improvements  to  the  ASAP  procedures  are 
being  developed  and  will  be  tested  by  repeating  a  portion  of  one  of  the 
experiments.  We  also  are  using  the  AFGL  GDAS  in  a  series  of  OSSEs  now 
underway . 
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Appendix  A 


Super  -  Observations  (super-obs! 


We  have  developed  a  procedure  to  form  super- obs  from  the  FGGE  Level  II 
cloud  drift  winds  (CDWs) .  While  doing  this  we  discovered  that  the  final 
reprocessed  data  set  contains  many  duplicate  observations.  Each  pair  of 
duplicate  observations  contains  an  original  observation  and  a  quality 
controlled  observation;  the  only  difference  between  the  two  are  the  quality 
control  flags. 

The  purpose  of  super-obbing  is  to  compress  large  data  sets  containing 
highly  correlated  and  hence  redundant  observations.  Employing  redundant  data 
can  make  the  mathematics  of  the  01  problem  ill-conditioned,  and  it  also  re¬ 
duces  the  efficiency  of  the  procedure.  In  addition,  the  AFGL  01  may  ignore 
large  blocks  of  data  because  of  core  space  limitations;  compressing  redundant 
data  should  reduce,  if  not  eliminate,  this  problem.  CDWs  in  particular  are 
often  very  closely  spaced  (hence  redundant)  and  very  numerous  (frequently 
>  5,000  in  a  6-hour  period). 

Some  forecast  centers  employ  rigorous  data  selection  to  thin  large  data 
sets,  but  this  procedure  does  not  necessarily  eliminate  redundance.  We  have 
followed  a  procedure  similar  to  the  European  Centre  for  Medium  Range  Weather 
Forecasts  (ECMWF)  and  formed  super-obs  by  merging  together  highly  correlated 
observations.  We  form  super-obs  in  a  preprocessing  step  before  the  data  are 
made  available  to  the  01. 


After  eliminating  duplicate  reports  in  favor  of  the  more  recent  NASA/NMC 
special  effort  quality  controlled  data,  the  super-obbing  program  forms  cluster 
of  data  points  to  be  combined  by  following  tour  steps: 

1)  Observations  are  assigned  to  latitude- longitude  boxes.  These  are 
our  initial  clusters. 

2)  All  nearby  pairs  of  clusters  are  examined.  hairs  which  are  close 
enough  together  are  merged. 

3)  Each  observation  is  examined  to  see  if  it  would  be  better  assigned 
to  a  different,  cluster.  "Better"  here  means  that  the  total  variance 
within  clusters  is  reduced.  (See  Mather,  l*»/6 ,  Section  6.13.)  Steps 
2  and  3  are  repeated  until  there  are  no  changes. 


4)  Observations  and/or  super-observations  within  the  cluster  are  then 
combined  pairwise.  At  each  stage  the  closest  pair  is  combined  into 
a  super-ob.  When  the  separation  between  the  closest  pair  exceeds 
the  critical  distance  (equal  to  200  km)  the  procedure  for  this 
cluster  stops. 

When  two  observations,  either  of  which  may  be  a  super-obs  already,  are 
combined  into  a  super-obs,  all  associated  fields  are  combined.  In  this  way 
the  output  data  set  is  similar  in  form  and  content  to  the  input  data  set.  One 
additional  field,  the  number  of  observations  combined,  must  be  included.  For 
measured  quantities,  we  form  a  weighted  average.  For  variability  estimates, 
we  form  a  weighted  average  of  variances.  The  weights  are  the  number  of 
(super- )observations  in  each  of  the  two  inputs.  For  quality  control  flags, 
the  minimum  quality  is  assigned  to  the  new  super-obs.  Type  indices  are  re¬ 
tained  if  both  inputs  agree;  otherwise  they  are  set  to  unknown.  For  the  FGGF. 
Level  II  CDWs  the  specific  actions  taken  are  listed  in  table  A.l.  For  quality 
control  flags  two  matrices  ITAB30  and  ITAB36  are  used.  ITAB30  and  ITAB36  are 
based  on  Tables  XXX  and  XXXVI  of  Appendix  A  of  FGGF,  Formats.  For  ITAB30,  if 
i-1  and  j-1  are  the  values  for  Table  XXX  for  the  two  observations ,  then 
ITAB30(i,j)  is  the  corresponding  value  assigned  to  the  combined  observation. 
ITAB30  is  filled  so  that  it  returns  the  lower  quality  value  of  i-1  and  j-1. 
The  "not  specified"  category  overrides  all  others  but  "low  level..."  ITAB36 
is  based  on  the  same  general  principals  as  ITAB30.  "No  quality  control" 
overrides  all  others  except  "probably  incorrect,"  "incorrect"  and 
"erroneous."  Otherwise,  the  lower  quality  value  of  the  pair  is  returned. 

Code  4  is  not  defined  (and  should  never  be  referenced) ;  it  is  arbitrarily 
reassigned  to  code  3  ("erroneous")  using  the  table. 

Note  that: 

(1)  Observations  separated  by  more  than  100  mb  are  not  combined. 

(2)  Observations  with  IQCP  or  IQC  not  equal  toO,  1,  5,  6,  7  (i.e., 
unacceptable  observations)  are  not  used. 

(3)  Distance  used  by  the  program  is  chord  (or  Cartesian)  distance,  not 
great  circle  distance. 


Pairwise  combination  procedure  for  observation  characteristics. 
(The  symbolic  names  are  taken  from  Norquist,  1984) 


tem 

Name 

Procedure 

1 

ALAT 

Weighted  average 

2 

ALONG 

Weighted  average,  accounting  for  Greenwich. 

3 

IDA 

Keep  if  they  agree;  otherwise  account  for  midnight 

4 

I  HR 

Weighted  average,  accounting  for  midnight 

5 

IDSI 

Keep.  Will  always  agree. 

6 

ITSWD 

Keep  if  inputs  agree;  zero  otherwise 

7 

PRES 

Weighted  average 

8 

IQCP 

Assign  with  ITAB30 

9 

IQC 

Assign  with  ITAB36 

10 

TEMP 

Weighted  average 

11 

WD 

Weighted  average,  accounting  for  due  North 

12 

ws 

Weighted  average 

13 

IQCWD 

Assign  with  ITAB30 

14 

1QCWS 

Assign  with  ITAB30 

15 

OEVE 

Rms  weighted  average 

16 

OEPE 

Rms  weighted  average 

17 

IEHM 

Set  to  zero  if  either  is  zero;  otherwise;  weighted  average 

18 

PDC 

Weighted  average 

19 

ICC 

Keep  if  inputs  agree';  zero  if  either  is  zero;  9  otherwise. 

20 

ISWFP 

Keep  if  inputs  agree;  zere>  eetheiwiso 

21 

NOBS 

Add 

We  changed  the  01  so  that  it  recognize;,  the  new  quality  flags  Wo  did  not 
alter  the  observational  errors  of  the  super  ebbed  CDW  because  the  errors  of 
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